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ABSTRACT 



This thesis is a case study that compares actual 
costs to estimated costs for a State-of-the-Art (SOA) 
extension. The Advanced Nuclear Gamma-Ray Spectrometer 
(ANGAS) program initiated by the Defense Advanced 
Research Project Office ( DARPA ) in conjunction with the 
Research and Development Division of Lockheed Missiles 
and Space Company ( LMSC ) , Inc. is the subject of this 
case study. 

This thesis identifies: the original description of 
the technology extension; the methods used at Lockheed 
to develop SOA extension cost estimates; specific 
factors that helped and hindered accurate cost 
estimating and significant variances in cost and 
technological progress. 
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I. INTRODUCTION 



A. BACKGROUND 

The development of new weapon systems for the 
Department of Defense ( DOD ) frequently requires State 
of-the-Art ( SOA ) extensions. The difficulty of 
estimating development and early production costs for 
new systems when SOA extensions are involved often 
leads to cost overruns. In fact, contractors’ costs 
exceed project manager’s estimates for new projects 60 
percent of the time. [REF. 1 : p. 50-51.] 

Prior research has not solved the problem of 
accurately estimating SOA extension costs. These 
development and production cost overruns make it 
difficult for DOD to accurately compare existing weapon 
technology with undeveloped technology. 

Professor Willis R. Greer, Jr., Naval Postgraduate 
School, Monterey, California, in conjunction with the 
Naval Sea Systems Command (NAVSEA), is attempting to 
develop more reliable methodology for estimating the 
cost of extensions as applied to electronic systems. 
This thesis provides data to support that effort 
through the case study of an SOA extension. 

B. OBJECTIVES 

This thesis details the Advanced Nuclear Gamma-Ray 
Spectrometer (ANGAS) experiment program initiated by 
the Defense Advanced Research Projects Office in 
conjunction with the Research and Development Division 
of Lockheed Missiles and Space Company, Inc. The 
objectives are outlined below: 

1. Identify the original description of the 
technology extension, 

2. Document estimated development costs. 
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Describe the methods used to develop the cost 
estimates , 

4. Compare actual cost data to estimated costs, 

5. Analyze and measure any significant variances 
in cost or progress in technological 
development , 

6. Identify specific factors that help or hinder 
accurate cost estimating. 

C. RESEARCH QUESTIONS 
Primary Research Question: 

How do estimated development and production costs 
compare with actual costs for the ANGAS project? 
Subsidiary Research Questions: 

1. What methods and techniques were used to 
estimate development and production costs? 

2. How was technological progress measured and 
evaluated? 

3. What factors helped or hindered accurate cost 
estimating and accomplishment of stated SOA 
extension goals? 

D. SCOPE LIMITATIONS AND ASSUMPTIONS 

This thesis is a case study of the ANGAS project. 
The primary task is to obtain and analyze estimated and 
actual cost data, document cost estimation procedures 
for the ANGAS project and to evaluate generic cost 
estimating procedures used by Lockheed for SOA 
projects. The technological requirements of the ANGAS 
project are studied to measure the accomplishment of 
stated ANGAS technological goals. 

The ANGAS project, an ongoing effort at Lockheed, 
is designed to produce one end unit to fly aboard a 
satellite. Thus, the cost data and estimation 
procedures presented in this paper are more applicable 
to development costs rather than to production costs. 
This is important because many SOA extensions, by their 
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nature, must be implemented through a substantial 

development effort. At the outset of many SOA 

development efforts, the end unit is more of an 

abstract idea than a detailed production specification. 

In the 1970 ’s, system acquisitions programs were 
usually focused on specific technical approaches at 
the time of their initiation. 

Today a program is initiated after competent 
authority, the Program Decision Authority, approves a 
specific. formally stated mission need, based on 
Mission Area Analysis, submitted within the first 
Program Objectives Memorandum in which program funds 
are requested. [REF. 2 : p. 1-7. ] 

E. METHODOLOGY 

The methodology used in this research is case 
study. Research trips to Lockheed included visits with 
the ANGAS contract administrator, principle 
investigator, senior cost estimator and several 
development engineers. These Lockheed personnel are 
located at facilities in Sunnyvale and Palo Alto, 
California. Lockheed personnel provided estimated 
costs, the associated cost estimation methods, actual 
costs incurred to date, a summary of progress, 
technological breakthroughs and specific factors that 
have helped and hindered the SOA extension effort. 

The NAVPRO office, located in Sunnyvale, was 
visited numerous times to identify a suitable contract 
for study and to obtain relevant contract and cost 
data . 

The ANGAS program manager was also interviewed to 
determine what the government hoped to achieve from the 
ANGAS project and how technological progress of that 
project is measured. 

Background and research data were obtained through 
the Naval Postgraduate School library and its research 
services. Automated searches were conducted through 
the NPS library’s DOD , NON-DOD and Defense Technical 
Information Center’s files. Information obtained 
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through visits to Lockheed during the case study and 
related research material is contained in this thesis. 



F. SUMMARY OF FINDINGS 

Major findings of this thesis are summarized below: 

1. There were no significant variances between 
estimated an actual costs to date. Spending 
was at a slightly lower rate than anticipated. 



2. Like many research and development projects 
that are administered by a "level of effort 
contract", measurement and analysis of 
technological development is the primary gauge 
of effectiveness and progress. 

3. SOA extensions, achieved by numerous smaller 
scale projects that incrementally extend the 
SOA, reduce the risk of both costs overruns and 
failure to achieve technological goals. 

4. Personnel costs are the most significant cost 
factor in the development phase of SOA 
extensions . 

5. Incremental funding of a DOD SOA project 
provides leverage to the government that can 
reduce cost overruns and achieve desired 
technological goals but tends to increase the 
length of time required for the development 
effort . 

6. Currently available parametric models, used in 
private industry, could be applied to 
government use with proper historical data 
application and case-by-case analysis. 



G. ORGANIZATION OF STUDY 

Chapter II provides a background of the ANGAS 
project, an overview of cost estimation procedures used 
for ANGAS and a summary of cost estimation procedures 
and models used at Lockheed. 

Chapter III details the methodology used in this 
thesis and present data. 

Chapter IV analyzes the data in chapter III 
consistent with the stated objectives. 

Chapter V states the conclusions drawn from this 
SOA extension case study. 
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II. BACKGROUND 



A. PROJECT OVERVIEW 

The Defense Advanced Research Projects Agency - 201 
ANGAS program involves the design, test and 
fabrication of the ANGAS flight instrument and the 
performance of a long term flight demonstration in 
space. [REF. 3 : p. 3-2. J 

The ANGAS project is designed to develop a gamma- 
ray spectrometer that will be carried into orbit by 
satillite. The spectrometer is designed to pasively 
detect radiation in space through an array of germanium 
sensors. The project will be completed when the 
designed spectrometer has been flown in space and the 
specified scientific results have been supplied to the 
government. The specific requirements of the ANGAS 
project are provided in the Statements of Work listed 
in Appendix B. 

The ANGAS system required development of a large 
mult i -element array of new, n-type , segmented germanium 
sensors. The design concepts represent a research and 
development effort which has never been performed 
before. This SOA extension in gamma-ray spectrometers 
incorporates the following new technologies: 

1. Imaging collimator, 

2. Cooled, radiation resistant n-type germanium 

sensors , 

3. Anticoincidence shield, 

4. Electronics subsystem which enables rapid 

onboard data analysis and microprocessor 
control , 

5. Solid cryogen cooler. 

The ANGAS program is being developed by Lockheed 
Space Sciences Laboratory which is part of the Lockheed 
Research and Development Division, the principle 
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